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The following is a brief description~are 
discussion of the procedures used by the Na- 
tional Archives of Canada (NA) to process the 
electronic records of the Trade Negotiations 
Office (TNO) micro computer network. 


Background 

The TNO network became operational in 
February 1987 and served as a communica- 
tion, operational and administrative support 
tool for the organization until it ceased to exist 
on March 31, 1989. The network was com- 
prised of more than 150 personal computers 
connected to "servers" computers that acted as 
storage and communication machines for the 
pe’s. The initial copying took place from 
January to March 1989. 

The records were stored by TNO on 3M 
tape cartridges capable of holding 60 Mbytes 
each. One tape cartridge was used to copy the 
records of each server on the network. There 
were six servers at the start and two others 
were added as the network grew. National 
Archives staff copied these tape cartridges on 
to optical storage devices called "WORM" 
cartridges (WORM is an acronym for Write 
Once Read Many Times). The bulk of the copy- 
ing was done using a tape drive and software 
loaned to NA by TNO. The WORM hardware 
was purchased by NA for this project. TNO 
also copied some tapes on their premises. Two 
other sets of electronic records were also ac- 
quired by NA. One set consisted of several 
hundred floppy discs from AES and MICOM 
word processors. The other set was a series of 
reel to reel tapes from a GEAC mini computer 
used by TNO prior to the advent of the micro 
network. A large quantity of paper records 
was also acquired. This description applies to 
the records from the network of pc’s only. 

There were several reasons for copying the 
records. First was to preserve the records 
which included preserving the structure of 
servers and sub-directories of the originating 
system. The structure gives some evidence of 
how the organization functioned. In addition, 
the system information such as file dates and 
access rights was preserved, again because it 
may have some evidential value. The second 
goal was to ensure that if some flaw in the 
processing method or other mistake was dis- 
covered at a later date, the original records 
would still be available. An example of this is 
the initial assumption that electronic mail was 
of no importance. Later examination of these 
records seems to indicate that some important 
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mg The third goal was to provide a live, 
Je set of records on which to experiment. 
“ would allow us to test various theories 
About and approaches to acquisition, process- 
ing and access to records from automated of- 
fice systems. 

Atthesametime, the extraordinary volume 
of records presented some challenges. At the 
completion of the initial copying, NA had 18 
WORM cartridges of 800 Mbytes capacity 
each. They contained some 400,000 electronic 
files (documents) or the equivalent of 2.66 mil- 
lion pages or 1,330 linear feet of paper. There 
were several related issues. The initial copyin 
included all the software used by TNO. This 
raised the possibility that NA was violating or 
might violate the copyrights or license agree- 
ments for the software. Furthermore, such a 
volume presented a real problem of access. 
The users of the TNO network were free to use 
any organising scheme they wanted, includ- 
ing none at all. There was no subject or other 
classification system in effect and TNO used a 
wide variety of software packages, each with 
its own proprietary format. 
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Procedure 

1. All files were copied from the backup tapes 
to WORM cartridges. The aim was to preserve 
all the files, directories and related informa- 
tion. Unfortunately, this was not always pos- 
sible. New directories are dated with the date 
they are created on the WORM. Problems with 
tape errors forced the staff to do some transfers 
by manipulating the program directly, which 
resulted in the loss of one or more files. Oc- 
casionally errors occurred and some portions 
of tape cartridges could not be transferred. 
(These errors were likely the result of 
deterioration of the tapes after up to two years 
of storage in a normal office file cabinet.) This 
was not the procedure envisioned at the start 
of the project. The original plan was to transfer 
from tape toa hard disc, check the records, and 
then copy them to a WORM cartridge. A large 
enough hard disc wasn’t available for the ini- 
tial copying, so it was done directly to the 
WORM. Since a WORM cannot be erased, er- 
rors in the copying process are permanently 
recorded on the WORM cartridges. Moreover 
the software used by TNO to create the backup 
tapes placed files on the tapes in alphabetical 
order of the file name. The original order was 
most likely by file date and time. 


2. Six months later,each WORM was copied to 
a hard disc using the DOS XCOPY utility with 
the "switches" set to make sub-directories as 
necessary. First the WORM cartridge with the 
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earliest date (March 14, 1987) was copied in its 
entirety. Subsequent WORM cartridge copies 
were made with the date switch of XCOPY set 
to the date of the previous backup, e.g., the 
copy of the March 28, 1987 set of files was 
made with the date switch set to /d03-14-87 
(March 14, 1987). This caused XCOPY to only 
copy files with the DOS date of March 14, 1987 
or later. Thus, only files that were created or 
modified since the previous backup were 
copied to the hard disc. This eliminated the 
files that people kept around in their direc- 
tories but never changed. Each copy was put 
in its own sub-directory named Nyymmdd, 
i.e.,"N" and the date of that particular backup. 
This was done so that files of the same name 
would not over-write previous versions and so 
that the order and structure of the records is 
preserved. The "N" was used because some 
software has difficulty dealing with directory 
names that begin with a number. 


3. Files ending in .com, .exe and .arc were 
removed, using the DRDOS utility XDEL. This 
was done to remove the software from the 
"working copy,” so that the copyright would 
not be violated. 


4. The result, typically 3,000 files occupying 20 
MB, was then copied to a WORM cartridge 
"working copy." 

Transfer times were generally about one 
hour from tape to WORM, two hours per 
WORM to disc, 15 minutes deletion time, and 
one hour from disc to WORM. Transfer speed 
appeared to depend almost entirely on the 
speed of the WORM, the tape and the hard 
disc; CPU speed had very little impact on the 
process. This is another example of how an old 
pe can be used for copying. 


Access 

At this point experiments with a number of 
software packages had been done in order to 
overcome the access problems. Memory Lane 
was tried but it could only deal with one group 
of records of about 3,000 files. Another 
product, Zyindex, had to be preset for a par- 
ticular originating software package and so 
could not cope with the variety in use at TNO. 
Magellan from the Lotus Corporation was 
then tried. This economical package (under 
$200) solved many of the problems. It can 
automatically recognize, display and print 
most of the formats in the TNO files. It 
provides full text searching and cut and paste 
facilities suitable for researchers. Its biggest 
shortcoming is that it is limited to about 10,000 
files at a time, which forces the sub-division of 
TNO records. 
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Recently the staff has begun testing a new 
software package called Research Assistant 
which goes beyond normal full text searches. 
It is capable of searching text in several lan- 
guages, including English and French, simul- 
taneously. It can respond to inquiries as 
general as "Why is the free trade agreement 
important to Canada?" While the depart- 
ment’s experience with this software is 
limited, it does seem to provide access to large 
volumes of electronic records without theneed 
for large thesauri, complex Boolean queries or 
multiple searches on collections involving 
more than one language. This software is 
being tested on real records to identify its 
strengths and shortcomings. 


Conclusion 

While the National Archives has gained a 
great deal of practical experience in dealing 
with records from electronic office systems, a 
number of problems still remain, but the 
department is optimistic that such records can 
be acquired, preserved and accessed. This is 
vital, because such systems are becoming the 
norm in both the public and private sectors. 


Douglas Taylor-Munro 
Government Archives Division 


Archival Processing of 
Electronic Records 


From an archival perspective the acquisi- 
tion of the records of the Trade Negotiations 
Office (TNO) represents a uniqueopportunity. 
Seldom do archives have the opportunity to 
acquire records so quickly after the active 
phase of their life cycle has past. Rather than 
letting years pass the National Archives will 
be able to appraise these records in a context 
which will facilitate description and more 
readily allow the identification of missing 
parts of the records. This applies to both the 
paper and electronic records of this office, but 
most particularly to the electronic records. 

The nature of electronic records and the 
means by which they are created are so ob- 
viously technologically bound. This is already 
well understood in the archival community; if 
records are not processed shortly after their 
acquisition, technological and conservation 
factors soon loom into view and eclipse the 
records. Though this has been recognized, the 
difficulty has been in arriving at accepted 
standards of selection, description and arran- 
gement of electronic records. This short article 
is intended to outline some of the work done 
in this area since the acquisition of the TNO 
records. 

The electronic records of TNO fall into six 
sub-categories determined by the computer 
used to create them. Two of these systems 
represent files created in a network environ- 
ment, three are exclusively word processing 
files, and the sixth system has not yet been 


fully identified. A fterthe preliminary selection 
of the records created in the network environ- 
ments it was found that nearly all these records 
consist of word processing records with the 
occasional spreadsheet and dbase III file.* 
Therefore, the task confronted was to bring 
order to 5 gigabytes of word processing files. 

The first step was to determine the linkages 
between the electronic records and the paper 
records acquired from TNO. Up to this point 
word processing systems and personal com- 
puters have been viewed principally as tools 
to create records and that those records end up 
in the paper filing system of the office. Office 
automation has evolved somewhat since this 
assumption was first made. The establishment 
of Local Area Networks (LANs) within offices 
has altered the way people use computers. The 
use of computers as communication devices, 
particularly electronic-mail, has meant that in- 
dividual work spaces now contain more 
varied information received from other users. 
This evolution is reflected in the use of com- 
puters by TNO. 

Initially, the office was equipped with 
MICOM and AES word processing systems, 
used largely by administrative staff to prepare 
correspondence and formal memoranda. In- 
dividual officers had their own personal com- 
puters of assorted manufacturers, including 
IBM, Olivetti and Apple. In 1985 a GEAC com- 
puter network was installed in TNO. This was 
replaced by the 3 Com IBM based LAN in 
February 1987 and was used by nearly all the 
staff. 

A document interchange package 
(KEYWORD 2000) was used to convert the 
MICOM and AES documents to WordPerfect 
4.2 so as to allow viewing of the documents. 
An interesting side issue was confronted at the 
time of conversion. MICOM allowed users fif- 
teen characters for file names, while 
KEYWORD would allow only the first eight 
characters as the file name with the extension 
.doc being added automatically. This automat- 
ic truncation of the original file name in many 
cases altered the sense of the name given to the 
file by the user, a practice which would never 
be condoned in an archival context for paper 
records. Fortunately, the document conver- 
sion package allowed fora solution: the details 
of each document conversion was recorded in 
a "log" for each of the MICOM disks. This log 
will serve as a form of "finding aid" for each 
disk, recording original file titles and the new 
titles, as well as any errors or document codes 
not supported in WordPerfect. 

Once the conversion of the MICOM and 
AES disks were carried out the archivist was 
able to compare these records with the paper 
records from the TNO registry. To some extent 
the original assumption about word process- 
ing files as duplicates was borne out by this 
comparison. However a good deal of the 
records from these disks fell into two other 
categories not found amongst the registry 
material. Some of the records had file titles 


which led one to believe they were also filed 
and/or created at the Department of External 
Affairs and International Trade Canada, the 
larger authority under which TNO existed. 
There were also a number of other files which 
were not present amongst the paper records. 

This first group of files presented a problem 
for the archivist. These records will very likely 
be acquired through the existing records 
schedule for the Department of External Af- 
fairs and will be found with other material on 
the subject of trade between the United States 
and Canada. Although the electronic records 
are most likely duplicates, this will not be 
known for some time. In addition, to select the 
records out of this fond would eliminate the 
evidential value of these records. 

The second group of electronic documents 
described above poses a different problem. 
Efforts have been made to determine why 
these documents are not included in the paper 
registry material. No easy solutions to this 
question have presented themselves. Al- 
though the records were only created in the 
last five years, it has not been possible to find 
anyone who could answer fundamental ques- 
tions about the creation of these records and 
their organization, if any existed. The only 
approach that was feasible was to use internal 
evidence from the documents to identify the 
creator of the records or the individual for 
whom the records were created. This informa- 
tionalong with an organizational chart of TNO 
and the subject matter of the documents has 
been used to draw some conclusions about 
these records for the purpose of description. 
Short of a description of each electronic docu- 
ment, this was seen to be the only way in which 
a satisfactory description could be achieved. 

At this time, the detailed work on the LAN 
records is not as advanced as it is for the 
records outlined above. The records from the 
LAN are far greater in volume and, fortunate- 
ly, have some inherent organization — the 
Original network architecture has been 
preserved in the copying of the records. The 
initial work on these records seems to indicate 
that at least a greater portion of them are not 
found amongst the paper records. However, it 
will take more work before this is certain. 


Paul Marsden 
Government Archives Division 


* "Preliminary selection" is the process described by 
Douglas Taylor-Munro in his article in this issue. 


Anyone wishing information about the Bulletin may 


write to: National Archives of Canada, Harold 
Naugler, Director, Manuscript Division, 395 Wel- 
lington Street, Ottawa, Ontario K1A 0N3, or phone 
(613) 996-8498. 
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